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Motivated by regularities observed in time series of returns on 
speculative assets, we develop an asymptotic theory of GARCH(1,1) 
processes {yk} defined by the equations yk = crkEk, al =uj + ayk-i + 

I3cr‘l_i for which the sum q +/3 approaches unity as the number of 
available observations tends to inhnity. We call such sequences near- 
integrated. We show that the asymptotic behavior of near-integrated 
GARCH(1,1) processes critically depends on the sign of 7 := a -|- /3 — 

1. We find assumptions under which the solutions exhibit increas¬ 
ing oscillations and show that these oscillations grow approximately 
like a power function if 7 < 0 and exponentially if 7 > 0. We estab¬ 
lish an additive representation for the near-integrated GARCH(1,1) 
processes which is more convenient to use than the traditional mul¬ 
tiplicative Volterra series expansion. 

1. Introduction. We study the GARCH(1,1) model of Bollerslev (1986) 
in which the time series {yy} follows (2.1) and (2.2) of Section 2. The 
GARCH(1,1) specification is commonly used as a good approximation for 
modeling volatility of financial and econometric heteroskedastic time series; 
see Chapter 15 of Hull (2000) and Chapter 7 of Zivot and Wang (2003) for 
practical applications and further references. This paper is motivated by the 
well-established fact that for most time series of returns on speculative assets 
the sum a + /3 is very close to 1. This observation led Engle and Bollerslev 
(1986) to introduce the so-called integrated GARCH or IGARCH processes 
which in the setting of (2.1) and (2.2) are defined by the condition a + /3 = 1. 
The term “integrated” is borrowed from the classical theory of linear time 
series [see, e.g., Brockwell and Davis (1991)], in which a random sequence 
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{xfc} is said to be integrated if the sequence of differences ut = xt — xt-i is 
stationary. If this is the case, the Xk are sums or “integrals” of the Uk- The 
sequence {xk} is then typically not stationary and its realizations resemble 
a random walk. To see why a GARCH(1,1) process with a + P = 1 might 
be called integrated, note that ( 2 . 2 ) may be rewritten as 

yl = (a + P)yl_i + Cfc - Pek-i, et := (ef - 1 )ct^. 

If there is a strictly stationary solution {yk} to (2.1) and (2.2) and Ee^ = 1, 
then {ck} is a sequence of martingale differences, so the follow an ARMA(1,1) 

process which is integrated (with Uk = Ck — Pck-i) if a + /9 = 1. The above 
argument assumed, however, that {yk} was stationary, so y1 cannot be non¬ 
stationary, unlike in the case of ARMA(1,1) processes with independent in¬ 
novations Ck- In fact, Bougerol and Picard (1992) showed that if a > 0 and 
P > 0 and a + P = 1, then the GARCH(1,1) process is strictly stationary. 

The objective of the present paper is to investigate the asymptotic be¬ 
havior of the GARGH(1,1) process when the sum a-|-/3 is not necessarily 
equal to 1, but is close to 1, as is the case in applications. This is achieved 
by allowing both a and P to be functions of the sample size n; the larger 
the sample size n is, the closer the sum a -|- /3 is to unity. 

To illustrate some corollaries to our results, set 7 = a -|- /? — 1. Note that 
if I 7 I = n“'^ for some 1/2 < q < 1, then assumptions ( 2 . 12 ) and (2.18) are 
satisfied. Define yn oc /(n) to mean that yn/f{n) converges weakly to the 
distribution of the innovations £k- Then, assuming that for some 1/2 < q < 1, 

7 = —n~’^ in the case 7 < 0 and 7 = n~'^ in the case 7 > 0 , we conclude that 
under the assumptions stated in Section 2, 

if 7 < 0, yri oc (Theorem 2.2); 

if 7 = 0, yri oc (Theorem 2.4); 

if 7 > 0, yri oc (Theorem 2.6). 

The parameter uj is defined in (2.2). 

Under our assumptions, the sequence is therefore always nonstation¬ 
ary and its “oscillations” increase with the sample size at different rates, 
depending on the sign of 7 . The case 7 = 0 should be contrasted with the 
aforementioned result of Bougerol and Picard (1992) who showed that if a 
and P are fixed, then the processes {yn} is stationary but the expected value 
of its marginal distribution is infinite. Under our assumptions, the process 
{yn} is mildly explosive but after normalizing by converges to a random 
variable with finite fourth moment. Similar interpretation is valid in the case 
7 < 0 . 11 a + P > 1, the “oscillations” increase at an exponential rate. 

Our work is somewhat related to Nelson (1990a) who considered approxi¬ 
mating diffusion processes by discrete time sequences from the ARCH family. 
While his main focus was on the exponential GARCH processes, he also con¬ 
sidered as an example a GARCH(1,1)-M process which is a random walk 
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type process; we refer to the original work of Nelson (1990a) for the details. 
In our setting Nelson’s conditions (2.28), (2.29) and (2.33) can be stated, 
respectively, as ncOn uj >0, njn —> —0 £ 1^ and ^ a > 0. Since his 

goal was to obtain a continuous time diffusion process as a limit. Nelson 
needed the parameter uj also to depend on n. In our theory, the param¬ 
eter uj plays no role because we investigate what happens when the sum 
a + (5 approaches 1. Unlike Nelson (1990a), we assume that n| 7 n| —> oo and 
> 0. Our results show that assuming different rates of convergence 
leads to a completely different asymptotic behavior. 

In another related work, Kazakevicius, Leipus and Viano (2004) studied 
the stability of general nonlinear processes related to the ARCH(oo) mod¬ 
els. Their results apply, however, to situations when the limit is a stationary 
process. Specialized to GARCH(1,1) (see their Theorem 4.2 and Remark 
2 . 2 ), their results imply that On/Tn ^ ck/Tj where now a and 7 < 0 are the 
parameters of the limit process, is a sufficient and necessary condition for 
an appropriately defined convergence. We again refer to the original work of 
Kazakevicius, Leipus and Viano (2004) for full details which are too com¬ 
plex to be presented here. We study the case when 7 n —> 0 and, as a result, 
the finite-dimensional distributions of the GARCH(1,1) sequences, after ap¬ 
propriate normalization, converge to the finite-dimensional distributions of 
a process which is no longer GARGH(1,1). 

The term “near-integrated” in the title of the paper is used in analogy 
with the popular term “near unit root” which, in its simplest form, refers to 
an AR(1) process {xk} defined by Xk = pxk-i + 6 ^, where the are errors. 
The process {xk} is said to have unit root if p = 1 and near unit root if p 
tends to 1 with the sample size. 

The paper is organized as follows. In Section 2, we state the assumptions 
and the main results and provide a brief discussion of their significance. The 
proofs are collected in Sections 3-6. 

2. Main results. Starting with the initial values uo and yo = crQ£o, we 
define the sequences Ufc, 1 < A; < re, and Pfej 1 < A: < re, by the recursions 


( 2 . 1 ) 

Uk ^k^ki 


I < A; < re, 

( 2 . 2 ) 

+ OiVk- 

+ 

q 

1 

I < A; < re 

where 




(2.3) 

w > 0 , 

a > 0 , 

/3>0. 


Throughout this paper we assume that (2.1)-(2.3) hold and that eo, ei, £ 2 ,. • ■, £ 
are independent identically distributed random variables (not necessarily 
with mean zero) such that the distribution of £| is nondegenerate. 
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Nelson [(1990b), formula (6)] showed that the solutions to (2.1) and (2.2) 
can be written as 


(2.4) 


k 

= <^0 n (/5 + Oi^k-i) + 

i=l 


k—1 j 

1+X] “*■ 

j=i i=i 


1 < k <n. 


Nelson (1990b) also showed that has an a.s. limit, as k —>■ oo, if and 
only if 

(2.5) iillog(/3 + aeo) < 0, 

assuming that E\ log(/3 + ae^)] < oo. 

In this paper we assume that a = an and j3 = j3n and a ^ 0,/9 ^ 1, as 
n —> oo. In this case, by (2.7) below, 

lim Elog{Pn + ansl) = 0. 

n—^■oo ^ 


We are interested in the behavior of cr| and yu when 
(2.6) k = [nt] for a fixed 0 < t < 1. 

In fact, we study finite-dimensional distributions, but assumption (2.6) con¬ 
veys the idea and is extensively appealed to in the proofs. 

For reasons explained in the Introduction, we assume that 


(2.7) 

Eel — 1- 

We will show that the behavior of cr^ (the behavior of can then be 

easily derived) critically depends on whether the quantity 

(2.8) 

7 = 7n:=a-h/3-l 

goes to zero from left or 
Throughout the paper 

right or 7 = 0. 

we use all or some of the following assumptions: 

(2.9) 

Eel < oo. 

(2.10) 

^ 0, 

(2.11) 

na oo. 

(2.12) 

o 

T 


In the following, we will often work with the random variables 
(2.13) = £"-!• 

Our first result establishes an additive representation for which should 
be contrasted with the multiplicative representation (2.4). The representa¬ 
tion in Proposition 2.1 is valid for near-integrated GARCH(1,1) sequences 
under the stated assumptions. Representation (2.4) is easy to obtain for any 
GARCH(1,1) sequences by the repeated application of (2.2). The proofs of 
the remaining results are based on Proposition 2.1. 
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Proposition 2.1. If (2.6), (2.7) and (2.9)-(2.12) hold, then 


+ O' ^ fk-j + Rk'^ 



+ CO 

1+ ^ en(i+a ^ 4 _. +4^(1 +fig) 

V !<«<! / 

The remainder terms satisfy 

(2.14) 


II 

0 

+ 

to 

(2.15) 


max = Op{ka^), 

l<j<k 

(2.16) 


max .\r[ — Op{a ) 

i<j<k jloglogj 

{we set log log X 

= 1 if X <4) and 

(2.17) 


max i R®. = Op(q:^+ 7 ^). 


Remark 2.1. In relations (2.14)-(2.17) and throughout the paper, the 
symbols Op and op are meant as n ^ oo, although in many places the 
formulas contain only the letter k. However, because of assumption (2.6) in 
which t is fixed, everything in the considered formulas depends in fact on n. 


We describe now the asymptotic behavior of the vectors , m = 

1,2,..., N] and [y[nt„,] j Ri- = 2,..., A^] , where is a hxed integer and 

0 < H < ^2 < ■ ■ ■ < ^ 1- 

We first consider the case 7 < 0. We assume 


(2.18) 

n|7| 

^ 00 

(2.19) 

an^/^log logn 

^ 0 , 

( 2 . 20 ) 

|^|3/2 

^ 0 , 

a 


( 2 . 21 ) 


< 00 


for some (5 > 0 . 


Theorem 2.1. Suppose 7 < 0 and assumptions 
and (2.18)-(2.21) hold. Then the random variables 



1 

■ 2 

a 


UJ 


E 




are asymptotieally independent standard normal. 


(2.7), (2.11), (2.12) 
1 <m < N, 
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Theorem 2.2. 
variables 


Under the assumptions of Theorem 2.1, the random 



1/2 

y[ntm] ? 


1 < m < A^, 


are asymptotically independent, each with the asymptotic distribution equal 
to the distribution of Eq . 


Theorems 2.1 and 2.2 are proved in Section 4. 
Next we consider the case when 7 = 0. 


Theorem 2.3. Suppose 7 = 0 and assumptions (2.7), (2.10), (2.11) 
and (2.21) hold. Then 




n 


3/2 


a 


Efl 


[ntr, 


UJ 


- - = 1 , 2 ,. 


,iV 


[Cm; ^ — 1 ) 2 ,..., N ], 


where [Cm) m = l,2,... ,N] is an N-variate Gaussian vector with mean zero 
and covariances 


E[CiCj] = g[min(ti,tj)]3. 


Theorem 2.4. Under the assumptions of Theorem 2.3, the random vari¬ 
ables 

are asymptotically independent, each with the asymptotic distribution equal 
to the distribution of Eq . 


Theorems 2.3 and 2.4 are proved in Section 5. 

Finally, we consider the case 7 > 0. In this case, we also need assumptions 
(2.18) and (2.19), but assumption (2.20) is strengthened to 

( 2 . 22 ) 1 = 0 ( 1 ). 

a 


Theorem 2.5. Suppose 7 > 0 and (2.7), (2.9), (2.11), (2.18), (2.19) and 
(2.22) hold. Then the vector 


76 


-[ntm]l ( a 


[ntr, 




oJ7 


^<j<[ntm]-l 


, m = 1 , 2 , 


,N 


converges in distribution to the vector \W{tm)-,'ni = 1 , 2 ,..., A^], where IT(-) 
is a Wiener process. 
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Table 1 

Estimated parameter values and the implied value of 
7 based on S&P 500 returns shown in Figure 1 


n 

a 

/3 

7 

200 

0.002421982 

0.993589156 

-0.003988862 

300 

0.0003888147 

0.9907158442 

-0.008895341 

400 

0.002953501 

1.002814152 

0.005767653 

500 

0.007391279 

0.992564947 

-4.3774e- 05 

1000 

0.020334508 

0.971043772 

-0.00862172 

1500 

0.03366838 

0.95160780 

-0.01472382 

2000 

0.065761052 

0.925748954 

-0.008489994 

2500 

0.057004888 

0.938578695 

-0.004416417 


Theorem 2.6. Under the assumptions of Theorem 2.5, the random 
variables 

are asymptotically independent, each with the asymptotic distribution equal 
to the distribution of Eq • 

Theorems 2.5 and 2.6 are proved in Section 6 . 

We conclude this section with a brief discussion of our results. 

Mikosch and Starica [(2002), Section 3.2] discuss what they call the “IGARCH 
effect.” Using 9558 daily returns on the S&P 500 index from the mid- 
1950s to early 1990s, they estimate the GARCH(1,1) model on intervals 
Ik = [1,1500 + lOOfej. Denoting by Ok and Pk the estimates based on a re¬ 
alization over the interval Ik, they plot the sum -|- Pk against k and 
observe that this sum approaches 1 as fe increases. This observation and 
other arguments lead them to the conclusion that an IGARGH model is not 
appropriate for returns data and arises merely from “an accumulation of 
nonstationarities.” They say that if estimates are based on shorter samples, 
then the estimated value of 7 is not close to zero. We repeated the exper¬ 
iments of Mikosch and Starica (2002), but used more recent daily returns 
on the S&P 500 index starting January 1, 1990. We also worked with the 
Dow Jones Industrial Average over the same period, but the results were 
very similar, so we focus below only on the S&P 500 index. Figure 1 shows 
2500 continuously compounded (logarithmic) daily returns on the S&P 500 
index starting January 1, 1990. 

Table 1 shows the estimated parameter values and the implied value of 
7 based on S&P 500 retnrns over the intervals {l,2,...,n}, where time 1 
corresponds to January 1, 1990. The estimates were computed using pseudo¬ 
maximum likelihood estimators; that is, the estimates are the values which 
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maximize the likelihood computed under the assumption that the errors Ek 
have standard normal distribution. It is seen from Table 1 that the values of 
a and 7 are indeed very close to 0 ; it is, however, less obvious that the value 
of 7 tends to zero with n, as claimed by Mikosch and Starica (2002). Thus, 
while keeping in mind that the empirical analysis in Mikosch and Starica 
( 2002 ) is more thorough than ours, we will satisfy ourselves by saying that 
the fact the values of 7 and a are often very close to zero is well documented. 

Our results lend themselves to the following interpretation: Rather than 
postulating that the observed sample {yi, 7 / 2 ) • • • jyw} follows one model, 
say, M, we consider a sequence of models, M„, such that the observations 
{yi, 7 / 2 ) • • •)yn} follow model Mn,n<N. This setting appears reasonable, 
because in practice the equality a + (5 = 1 never holds exactly and the case 
of the exact equality is mathematically very special. On the other hand, if 
OL and /3 are assumed constant and a + (5 <1, mathematically, we deal with 
the usual stationary case, no matter how close the sum a + /3 is to unity. 

Since our objective was to develop a rigorous probabilistic theory for 
near-integrated GARCH(1,1) processes and point out some implications of 
commonly made assumptions, we do not wish to speculate at length on the 
empirical consequences of our theory; any such attempt must be supported 



Eig. 1. Twenty-five hundred continuously compounded daily returns on the S&P 500 
index starting January 1, 1990. 
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by a more extensive empirical investigation. We merely point out that since 
Un follows model M„, the observed sequence yn should have properties im¬ 
plied by the sequence of models M^. This means that the yn should exhibit 
increasing oscillations if the assumptions of the present paper are satished. 
Such oscillations are not apparent for the returns in Figure 1 up to, say, 
N = 1000, yet the estimated values of a and 7 are very small. This points 
towards a conclusion that it is not appropriate to use a GARCH(1,1) model 
with a close to zero and (3 close to 1 for all samples {yi,y 2 -, ■ ■ ■ -lyn}< 1000; 
such a model is not appropriate at least for some of these samples. Thus our 
results lend some qualified support to the findings of Mikosch and Starica 
( 2002 ), at least as far as modeling returns on indexes is concerned. 

3. Proof of Proposition 2.1. In the proofs that follow, we use ~ bn to 
denote lim^^oo an/bn = 1 . 

The proof of Proposition 2.1 will use the following elementary result: 

Lemma 3.1. If (2.6), (2.7), (2.9), (2.10) and (2.12) hold, then 

max 1/3 + — 1 | = op(l)- 

l<i<k 


Proof. Note that 

max 1/3 + — 1| < I 7 I + a max |e|_j — 1| = I 7 I + a max \e] — l\. 

l<i<k l<i<k 1 

Since are independent and identically distributed, assumption (2.9) and 
Corollary 3 on page 90 of Chow and Teicher (1988) yield 

max \e] — 1\ = a.s. 

Thus the lemma follows from (2.12) and (2.10) combined with (2.6). □ 

Proof of Proposition 2.1. The starting point is formula (2.4). By 
carefully estimating the remainder terms, we will show in three steps that 
it can be written as claimed in Proposition 2.1. 

Step 1. Consider the sequence of events 

An = { max 1/3 -|- ae1_^ — 1| < i >. 

By Lemma 3.1, lim„,^oo-P(A„) = 1. Since by the Taylor expansion | log(l + 
x) — x\< 2x^, |x| < 1 / 2 , on the event An, 

log(/3 + a4_J- Y (7 + «6-i) 

i<i<j i<*<i 

Y (7 + a4-j)^ < 47 ^ 3 +4a^ Y 

l<i<j l<*<i 
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By the law of large numbers and assumption (2.9), 

max + • • • + fk-j\ = -1^? + ... + ^2| = Op(l). 

Therefore 


log(/3 + aei_i 

l<i<j 


n (/3 + aei-i) = exp 

(3.1) . 

= exp(7j) exp a ^ ^k-i ) exp(r/fcj), 
\ l<i<7 / 


where 

(3.2) max =Op(a^+ 7 ^). 

We have thus shown that 

(3.3) Y[{f3 + a£l_i) = e^'^exp(a (1 + 

i=l \ l<i<j ) 

with i?®. satisfying (2.17). 

We also note at this point that by (3.2) and assumptions (2.10) and (2.12), 

(3.4) max^li?®.I = Op max = Op{k{a^ + 7 ^)) = op(l). 

Formula (3.4) will be used in the verification of (2.14) in step 3. 


Step 2. In this step we work with the middle factor in the right-hand 
side of (3.3). 

Since ^ 1 ,^ 2 , • are independent, identically distributed with < 00 , by 

the weak convergence of partial sums to a Brownian motion, we have 


(3.5) 


max 

i<i<^ 


I<*<i 


Op{k^/^) 


and therefore by assumption (2.10) 


(3.6) 


max 

l<j<k 


l<i<j 


Op(l). 


Let Bn be the event defined by 


B 


n 


max 

i<j<^ 


a 


^k-i 

l<i<j 
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By (3.6), lim„^oo-P(B„) = 1. 

Since for |x| <1/2, | exp(x) — (1 + x)| < y^x^/2, on the event B. 


(3.7) 

By (3.5) 

(3.8) 


exp j a y: 6-* - i+« e 


l<i<j 


I<*<i 


< 




' i<*<i 


max a 
i<j<k\ 


E ) =Op{ka^). 

l<i<j / 


By the law of the iterated logarithm 

1 / 


(3.9) 


max 


i<j<fe jloglogj 


a E ^ Op{a^ 

i<*<i / 


We have thus verified that 
j 


(3.10) n(/3 + ' 


ae^_i] = & 


-2 ' = ^Ul + a &_i + flg)(l + flg), 

i<*<i 


2 = 1 


with satisfying (2.15) and (2.16). 


Step 3. In this step we show that 


(3.11) 


]^(/3 + ae|_j) — ( 1 + a E ^k-i + R, 


( 1 ) 

k ’ 


2=1 


l<i<k 


with satisfying (2.14). 

By (3.10) and (3.4), 

{(5 + ael_i) = (l + a E Ck-i + Op{ka^)\{l + Op{k{a‘^ +'y'^))). 

l<i<k \ l<i<k J 

By the central limit theorem J2i<i<kCk-i = Op{k^^^), so using (2.10) we get 

|l-|-Q! E ^k-i + Op{ka^)\{l + Op{k{a‘^ +'y'^))) 

\ l<i<k / 

= 1 + 0 ; E ^k-i +Op{k{o? 

l<i<k 

establishing (3.11) with satisfying (2.14). 

The proposition now follows from (2.4), (3.10) and (3.11). □ 
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4. Proof of Theorems 2.1 and 2.2. Throughout this section we assume 
that 7 = 7 n < 0 and n| 7 | ^ oo. 

Using Proposition 2.1, we write for k = [nt],0 <t<l, 


(4.1) 


= UJ + 


l + a ^ 

&-J+ 


\ 

^ l<j<k 

/ 

/ 

+ UJ 

E 

gi7 n _|_ Q, 

E ^k-i + -R, 



-1 V 

!<*</ 

+ UJ 

E 





-1 

/ 

\ 

+ UJ 

E 

gi7 n _|_ gj. 

E ^k-i I 



-1 V 

\<i<i / 


(2) \ d(3) 


—: W + al l + ^k,2 + ^k,3 + ^1,4:- 

Since | 7 p/^/a —> 0, the constant term oj is asymptotically negligible in The¬ 
orem 2.1. In Lemma 4.3, we show that the term 




1 + a ^ ^k-i 


i<*<i 


yields the required asymptotic distribution. Since we work with finite-dimensional 
distributions, we set k{m) = [ntm] and consider the quantities 


(4.2) 


= E 




E l<m<N, 




which are obtained from uj ^ after centering and norming. 

In Lemmas 4.4, 4.5 and 4.6, respectively, we then show that the terms 
are negligible. 

We begin with Lemma 4.1, which is used throughout the proof, and 
Lemma 4.2, which applies Liapounov’s central limit theorem (hence the 
assumption < oo) and is then used to prove Lemma 4.3. 

Theorem 2.2 follows readily from Theorem 2.1 which together with the 
relation ^ (see Lemma 4.1) implies 


<7 


k{m) 


UJ 


— 1 = Op 


a 


|^|l/2 


= Op{l), 


because by (2.10) and (2.18), a/| 7 |^/^ —> 0. It remains to notice that 


l7l\ 

cu ) 


1/2 


yintm] ^k{m) 




UJ 


and appeal to the assumption that the £k(m)^ 1 <m < N, are independent 
and identically distributed. 
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Lemma 4.1. For any > 0, 


E 

l<j<k 


ItI 


u+l 


Tin + 1). 


Proof. Since is increasing on [0, 17I and decreasing on [I7I 

the sum can be approximated with integrals. Since 

r\l\~^v-l . r\'i\~'-v+l 

/ x^e^^dx< y fe^^< x'^e^^dx, 

Jo “'l 

we conclude that 


E ~ 


and a similar argument gives 


I 7 I 


1 f'' 

Jo 


x'^e ^ dx 


E ~ 


ItI 


v+l 


x'^e ^ dx. 


□ 


Before formulating our next lemma, we need to introduce new notation. 
For 0 < ti < t2 < • • • < < 1 dehne k{m) = [ntm], 1 <m < N, and 

(4.3) Tm= E l<m<N. 


Lemma 4.2. Suppose that E\£Qy^ < 00 for some (i > 0 and that as¬ 
sumptions (2.7) and (2.12) hold. Then 

{2\'y\y^‘^[Ti,T2,... ,tn]-^ {Ef,iy[m,V2, ■ ■ ■ ,Vn], 
where 71 , 72 ,--.jW are independent standard normal random variables. 

Proof. We will use the Cramer-Wold device; see Theorem 29.4 of 
Billingsley (1995). For any real //i,// 2 , • • ■ ,Tn 

hin + T 2 T 2 H-h Untn 

k{l)<i<k{2)-l 

fc(A-l)<i<fc(A)-l 

= : Si + S2 + • ■ • + Sj\[. 
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Observe that 

ESl = Eil Y. 

= Eil Y Y. ^ 

l<i<N l<i<fc(l)-l 

+ ^^0 I] Y ^ 

l<i<k{l) — l 

By Lemma 4.1, 

(4.4) ^ ^ 

l<i<fc(l)-l l<*<fc(l)-l 

and for 2 < j < N, 


,(fc(2)-i)7 _h 


+ 1^26 
,2(fc(i)-i)7 

{k{j)+k{l)-2i)'r 


_227 
6 ~ 


2 | 7 l 


(4.5) Y Y 

l<i<k{l)-l 


2(fc(l)-i)7 _ J_ 


ItI 


l<i<A:(l)-l 
Similarly, 


l<i<fe(l)-l 


Therefore 


l<i<fc(l)-l 


^ Jk(.i)-k(l)h Jk{l)-k(l)h —q( J_^ 

2 | 7 l \h\)' 


1 


1 


The same argument applies to ES'j for any 1 < j < A^, so we see that 

EipiTi + 1X2^2 H - h Untn)^ 

= (/r? + //i + • • • + + o ^. 

Observe also that 


(4.6) 


^klTl + IJ. 2 T 2 -\ -h/XATTAr— Y, 

l<i<k{N)-l 


for some Q, 1 < z < k{N) — 1. It will then follow from (4.6) and Liapounov’s 
central limit theorem [see, e.g.. Theorem 27.3 on page 362 of Billingsley 
(1995)] that 

+ IX2T2 H-h iintn) 

' ■' 4 (£{„=)' 7 (‘? + mD-- + R. 77 . 
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= 0 ( 1 ). 


where r/ is a standard normal random variable, provided we have verified 
that for some d > 0 

1 y/(2+5)-l/2 

Relation (4.7) implies the claim in the lemma, so it remains to verify (4.8). 
By (4.6), the denominator in (4.8) behaves like (l/jyl)^/^, so choosing <5 so 
small that < oo, it is enough to check that 

(4.9) E |«l"+‘ = 0(l/|7|). 

l<i<fc(A)-l 

To illustrate, we will verify (4.9) for the summation range 1 < f < k{l) — 1; 
the remaining ranges of i are dealt with in the same way. For l<i<A:(l) — 1 
we get, using Jensen’s inequality, 

|ci|2+^ = + • • • + 

Summing the above, we get, using Lemma 4.1 as in (4.4) and (4.5), 


^ |qP+^~Ci(A^)|//i|2+^ 


1 


l<i<fc(A)-l 


(2 + (^)l7l 


+ o 


1 

ItI 


< C2iN) 


ItI 


□ 


Our next lemma shows that the random variables defined by (4.2) 
have the same asymptotic distribution as the r^, 1 < m < 77. 

Lemma 4.3. Suppose that E\£q\‘^^^ < oo for some J > 0 and that as¬ 
sumptions (2.7) and (2.12) hold. Then 

(2|7|3)^/2[ti ,r 2 *,... ,ri(r] 4 • • •, r?jv], 

where pi,p 2 , ■ ■ ■ ,Vn o-re independent standard normal random variables. 

Proof. By Lemma 4.2, it is enough to verify that for each m, — 

= op(l)- Fix m and to lighten the notation set k = k{m). By rear¬ 
rangement. 


4= I] ( I] 


It is therefore enough to verify that 

" k—1 / k—1 \ k—1 


hiT 




L i=l \ j=i 


2 = 1 


= 0 ( 1 ). 






16 


I. BERKES, L. HORVATH AND R KOKOSZKA 


Since 

(4.10) 


k-l 




j=i 


okl _ g*7 

eT- - 1 


and [e'>' — 1 ] ^ = 7 ^ + 0 ( 1 ), we have 


k-l 


(4.11) 


^ e^''^ - = e^T'(7-i + 0(1)) + 6^0(1). 


j=i 


Hence, by (4.10), for 1 < i < A; — 1, 


'k-l 


(4.12) 


^e^T'-|7| =0(|7| ^). 


■ j=* 


By the independence of the 

" k—1 / k—1 \ 


(4.13) 


k-l 


i=l 

\ 2 


i=l \j=i / 

fc—1 / k—1 




--1^*7 


i=i \ j=i 


The claim thus follows by (4.12) and ^0. □ 

Lemma 4.4. If (2.6), (2.7) and (2.9)-(2.12) hold, then 


|^|S /2 


a 


,k-i I 


1 + a ^ ik-j + R, 


( 1 ) 

■k 




= op(l). 


where satisfies (2.14). 


Proof. Since k ^^‘^J2i<j<k^k-j is asymptotically normal, conditions 
(2.10), (2.12) and (2.14) yield" 


a ^ 6_,+i?W=op(l). 


It remains to observe that by (2.11) 

|^|3/2 


a 


e^T' = o(l)A;|7|e^T' = o(l) 


because 7 < 0, fcjyl ^ 00. □ 
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Lemma 4.5. Suppose (2.6), (2.7), (2.10) and (2.20) hold. Then 
|^|3/2 


a 


E 


oJ7 




1+0flg 


i<*<i 


= op(l), 


provided satisfies (2.15) and satisfies (2.17). 
Proof. By the weak convergence of partial sums, 


max 


E 

l<i<j 


= Op{k^/^), 


so by (2.10) and (2.15) 
(4.14) 


max 


a ^ + 

!<*<! 


= op(l). 


By (2.17), (4.14) and Lemma 4.1, 
h|3/2 


a 




E e" (1+0 E &-,+4!l PS 


l<i<j 


= Op(l)^(a2+f) ^ 

r\i • * 


a 




a 


= Op{l)— —(0^+7^) 


ItI 


2 ■ 


It remains to observe that 


ypn 


a 


(«2+72) 


a ^ | 7 | 3/2 


1 


(n|7|)^/^ a 

by (2.10), (2.18) and (2.20). □ 

Lemma 4.6. Suppose (2.6) and (2.19) hold. Then 


= o{l), 


h|3/2 


E i4jio'‘'=op(i), 


a 




provided satisfies (2.16). 
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Proof. Using (2.16), Lemma 4.1, (2.18) and (2.19), we have 


hi’/" 


a 




'(2)|gi7 


= Op(l)^^^^J— j{loglogj)e^'^ 

= Op(l)|7|^/^a(loglogA:)|7|“2 
= op(l)an^'^^ loglogn = op(l). 


□ 


5. Proof of Theorems 2.3 and 2.4. Throughout this section we assume 
that 7 = 0. 

As in the proof of Theorem 2.1, setting 7 = 0, we have for k = [nt],0 < 

t < 1, 


<^ + Cofl+Cl + R 

\ l<j<k 


( 1 ) 

k 


V i<*<i / 

+- E 

l<j<k-l 

+ ^ E (^■*"“E 




i<i<j 


—:u + all + (t| 2 + Tfc 3 + 4 . 


By (2.11), —> 00 , so the term uj is negligible in Theorem 2.3. In Lemmas 

5.2-5.4 we show that n“^/^a“^(fj^ 4 + erf 2 + erf 3) = op(l). Therefore 


(5.1) 


1 


r?l‘^a V w 


cr 


^-k\ = 


1 


n 


3/2 


E E '^fc-i + op(i). 


l<j<k-ll<i<j 

By (5.1) and Lemma 5.1, the finite-dimensional distributions of the process 

J2 


1 


1 


cr 


nt] 


— [nt] ), 0 < t < 1 


n^/^a[E^i]y^ \ io 

converge to the hnite-dimensional distributions of the process [/q x dW (x), 0 < 
t < 1]. Theorem 2.3 thus follows on observing that 


r rt 


xdW{x) / xdW{x) 


pmin(t,s) 


x^ dx = i[min(t, s)]^. 
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-j Q JD 

Theorem 2.3 and (2.10) imply that {^[ntm ])~^^ each 1 < m < 
N, so Theorem 2.4 follows because {u:[ntra])~^^‘^V[ntm] = 

Lemma 5.1. If (2.7) and (2.21) hold, then 

^-3/2 ^ Y. f^dW{x) inD[0,l], 

i<j<nt-l l<i<j 

where {lT(x),0 <x< oo} is a ITiener proeess. 


Proof. Note that 

Y ^k-i= Y {k-i)ik-i 


rk-1 


X 


/O 


4 E fi 

\l<j<x 


rk-1 




= (^ - 1) I] 0 - / I] 

By (2.7) and the Komlos, Major and Tusnady approximation [see Chapter 
1 of Csorgd and Horvath (1993)], there is a Wiener process W* such that 

E 0 - {EeoY^W*{x) = o{x^/^^A a.s. 


Hence 

(5.2) 
and 

(5.3) n“3/2 


n sup 
0<t<l 


I "'E Cj-{EeoY"W*{x)yx 


sup 

0<i<l 


= Op(l)n-3/2ni+V(2+5)=op(l) 


Y ^j-{Ee,Y^W*{nt-l)) 
\l<i<nt-l J 


= op(l). 


. ^<3<nt-\ 

In (5.2) and (5.3) we can clearly replace rat — 1 by nt. To complete the 
proof it is therefore enough to notice that, by the scale transformation of 
the Wiener process, 

|ra“^/^^ratW*(rat) — y W*{x)dx'^, 0<t<l| 

= |tlT(t) - y* W{x) dx, 0 < t < l| 
and use integration by parts. □ 
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Lemma 5.2. If (2.6), (2.7), (2.9)-(2.11) hold, then 


n 




1 + a ^ fk-j + Rk'^ 


where R 


( 1 ) 

k 


satisfies (2.14). 


op(l): 


Proof. By (2.7) and (2.9), Ei<j<k^k-j = so the lemma fol¬ 
lows immediately from (2.6), (2.10) and (2.11). □ 


Lemma 5.3. If (2.6), (2.7) and (2.10) hold, then 




E 1 + a E + 




l<i<j 


where r!'^^- satisfies (2.15) and satisfies (2.17). 


op(l)> 


Proof. By (4.14), it snffices to verify that J2i<j<k-i \R^k] \ ~ 

op(l) which follows immediately from (2.17), (2.10), (2.12) and (2.20). Re¬ 
call that to establish (4.14) we needed assumptions (2.6), (2.7), (2.10) and 
relation (2.15). □ 


Lemma 5.4. If (2.6) and (2.10) hold, then 

l<j<k-l 

where R^^'j satisfies (2.15). 

Proof. Follows immediately from (2.15), (2.6) and (2.10). □ 


6. Proof of Theorems 2.5 and 2.6. In this section we assume that 7 > 0 
and ny —> 00 . Note that the assumptions of Theorem 2.5 imply that all 
assumptions (2.9)-(2.12) hold. In particular, assumption (2.12) is implied 
by (2.19) and (2.22). 

We again use decomposition (4.1). Lemmas 6 .1-6.3 below imply that 


+ ^k,2 + ^ 1 , 3 ) — Op(l)- 

Therefore 





OJ 


E 


ryp I _ __ ___ 

i<*<i 
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By Lemma 6.4, the last relation implies 


ye 


—k^ 






pJ7 




= A: Ci + op(l), 




SO by Donsker’s theorem [see, e.g.. Theorem 14.1 in Billingsley (1999)], we 
conclude that the finite-dimensional distributions of the process 


1 

^g-[nt]7 

^[nt\ 

pi7 

C\ ^ i ^ ^ 

[(ES)'-'^ 

a[nt]i/2 

UJ 




converge to the hnite-dimensional distributions of the Wiener process \W (t), 0 < 
t < 1]. This completes the proof of Theorem 2.5. 

Theorem 2.6 now readily follows. For any 0 < t < 1, 


( 6 . 1 ) 

Since a[ret]^/^ —> 0, it follows from Theorem 2.5 that 


( 6 . 2 ) 




T e’'') =op(l). 


Direct verification shows that 


(6.3) 


76 


-[nt]7 I 


E 




ei7_^-ie[nth =o(l). 




Relations (6.2) and (6.3) yield uj 1, which combined with 

(6.1) concludes the proof of Theorem 2.6. 

Lemma 6.1. If (2.6), (2.7), (2.9)-(2.12) and (2.22) hold, then 


76 


—k'y 


„k-y I 


where satisfies (2.14) 


1 + a Ck-j + R, 


( 1 ) 

k 


l<j<^ 


= op{l), 


Proof. Relation (2.14) and the asymptotic normality of k J2i<j<k ^k-j 
yield 

=-^7 


76 




pkl I 


1 -|- a Y^ ik-j + R, 


( 1 ) 

k 


l<j<k 


= Op{l)—^{l -h ak^^^ + k{a^ + 7^)) 


: op(i) (T-v=+ 7 ++ hP^)=»p{i), 
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by ( 2 . 10 )-( 2 . 12 ) and ( 2 . 22 ). □ 

Lemma 6.2. If (2.6), (2.7), (2.9), (2.10), (2.12) and (2.22) hold, then 


'ye 


—k') 




E 




l + « ^ + 




i<*<i 


= opil), 


where r!'^^- satisfies (2.15) and satisfies (2.17). 


Proof. By (2.17) and (4.14), it suffices to show that the quantity 

o-k'y 


Vk = 


'ye 








tends to zero. Since for 7 > 0, 

(6.4) 

we have 


_ e7 

eT- - 1 


< 


gfc7 

7 ' 


14 < + (fe^/^y) — 

by (2.10), (2.12) and (2.22). □ 


a 


Lemma 6.3. If (2.6), (2.9) and (2.19) hold, then 

i; e'7dji=Mi). 


'ye 




where i?® satisfies (2.16). 


Proof. By (2.16), we need to show that the quantity 

o-k'l 


Uk = 


tends to zero. By (6.4), 


'ye 




e^^a^j'loglogj 


i<j<fc-i 

k'y 


Uk < —T-jTT^a^/cloglog A;-= ak^'‘^ log log A: = o(l). 




7 


by (2.19). □ 

Lemma 6.4. If (2.6), (2.7) and (2.9) hold, then 


k \ 


f.k'r 


1 : el-' j: y: «< 


0. 


i<*<i 


7 
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Proof. Note that 


and 


Therefore, 


E e” E &-i= E E 

l<*<j \i<j<fc-l / 




E E 

i<*<j i<i<fc-i ^ y 

/ k'y _ i'l k'f \ 2 

= Eeo E 


l<i<k-l 


e"! — 1 7 y 


By the Taylor expansion, 


gfc7 _ gi7 gA:7 


e"! — 1 7 


=*7 
—+ e^ 
7 


/c7 


Therefore, 


E 


l<i<fc-l 


gfc7_e*T' 

e'l' — 1 7 y 


<2Ci^ 

= 0 ( 1 ) 
= 0 ( 1 ) 


p2«7 

E V + 

Ll<i<fc-1 ^ 


1 - e^')' 

~ 6^7 -1 


7 






7" 


The claim follows on observing that 


2^ -2fc7 J_g2fc7 — A _> n 

k 7^ jk 


and 


= 7^ ^ 0. 

k 


□ 
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